Effects of Amplitude Envelope Cues as an Aid to Enhanced Speechreading

نویسنده

  • Ali Mansour
چکیده

This thesis developed methods of presenting two speech envelope cues in the small bandwidth likely to be available to people with severe hearing impairments. Identifying such methods could facilitate face-to-face communication substantially. Seven presentation conditions were evaluated. Two of the conditions, the OneEnvelope Monaural and the Two-Envelope Monaural, were developed by Grant, Braida and Renn (1991), and were used as a basis of comparison to the new conditions developed. The One-Envelope "Rough" Monaural, Two-Envelope "Rough" Monaural, Simple Binaural, Combination Binaural, and Low Binaural are the five presentation conditions developed in this project. Initial tests used normal hearing subjects to evaluate each proposed scheme. This avoided compounding perceptual interference factors with hearing loss. To ensure that these tests were indicative of the full potential of each method, subjects were familiarized with the envelope cues prior to testing. Results of testing suggest that two of the new presentation conditions may prove beneficial to the hearing impaired. Both the Two-Envelope "Rough" Monaural and the Combination Binaural conditions were particularly successful in conveying speech (average scores using Harvard sentences were 74.1% and 72.1%, respectively). Thesis Supervisor: Louis D. Braida Title: Henry E. Warren Professor of Electrical Engineering

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Speechreading Essentia Signal, Paralinguistic Cues, A

An overview of some results from our own studies on speechreading is presented. Focus is on paralinguistic cues that assist in perception of the spoken signal. We elaborate on how the contextual, and especially the emotional cues are utilised in speechreading. We further discuss which skills are important in integrating paralinguistic cues and the linguistic signal in speechreading. As a basis ...

متن کامل

Single station estimation of earthquake early warning parameters by using amplitude envelope curve

In this study, new empirical relationships to estimate key parameters in Earthquake Early Warning (EEW) system including magnitude, epicentral distance and Peak Ground Acceleration (PGA) are introduced based on features of the initial portion of P-wave’s amplitude envelope curve. For this purpose, 226 time series recorded by bore-hole accelerometers of Japanese KiK-net are processed for earthq...

متن کامل

Comparison between two methods of extracting supplemental information for speechreading

A pilot study was made to examine the efficiency of two auditory processing methods extraction of fundamental frequency and spectral gravity, both combined with intensity information as a supplenient to speechreading. Three normal hearing subjects showed improved ability to perceive sentences with supplemental signals presented auditorily. For two experienced subjects, the performance without t...

متن کامل

A speechreading aid based on phonetic ASR

Manual Cued Speech (MCS) is an effective method of communication by the deaf and hearing-impaired. We first describe our work on assessing the feasibility of automatic determination and presentation of cues without intervention by the speaker. The conclusions of this study are then applied to the design and implementation of a prototype automatic cueing system using HMM-based automatic speech r...

متن کامل

Automatic speech recognition to aid the hearing impaired: prospects for the automatic generation of cued speech.

Although great strides have been made in the development of automatic speech recognition (ASR) systems, the communication performance achievable with the output of current real-time speech recognition systems would be extremely poor relative to normal speech reception. An alternate application of ASR technology to aid the hearing impaired would derive cues from the acoustical speech signal that...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008